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ABSTRACT 

This report presents the results of a process 
evaluation of the Saginaw ^(Michigan) 1988-39 elementary and secondary 
Acaaemic Achievement (A2) compensatory education programs in reading 
and mathematics. Funding is provided by the Education Consolidation 
and Improvement Act (ECIA) Chapter 2, and by the state. Goals are the 
following: (1) provide intensive academic instruction for the 
educationally disadvantaged; (2) involve parents; (3) provide 
incentives for academic achievement; (4) operate staff inservice 
programs; (5) measure academic growth; and (6) prepare students for 
the general classroom. Data were analyzed from the following sources: 
(1) a survey of all teachers; (2) interviews with each school 
principal or assistant principal; and (3) observation of each teacher 
during an entire session. Program strengths included the following: 
(1) small group instruction on the elementary level; (2) individual 
attention; (3) use of new instructional te'**^niques; and (4) direct 
instruction. Program weaknesses include the following: (1) program 
changes disrupted the elementary staff, and secondary A2 lacked 
prepared materials; (2) focus restricted to the bottom quartile of 
students; (3) lack of formal communication between compensatory 
education and regular teachers; (4) low certification standards for 
elementary compensatory education teachers; and (5) lack of parent 
participation. Recommendations for improvement are included. 
Statistical data are included on one table. The appendices include 
copies of the evaluation instruments and tabulations of responses. 
(FMW) 
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P&OGSAM DBSCRIPTION 

The School District of the City of Saginaw operates a compensatory educa- 
tion delivery system in reading and mathematics consisting of two programs — 

2 2 
elementary and secondary Academic Achievement (A ). The elementary A is both 

a push-in program (that operates in the regular classroom in grade one) and a 

pull-out program (periodically taking students out of regular classrooms) that 

2 

serves 2,099 students in grades one through six. The secondary A is a self- 
contained classroou program which involved approximately 503 students in 

2 

grades seven through nine and twelve. The A programs are funued by both the 

Federal Educauion Consolidation and Improvement Act (ECIA) Chapter 1 and 

Article 3 of the State School Aid Act. 

Summarized in the chart below are demographic characteristics that 

2 

describe both the elementary and secondary levels of A in greater detail. 



DEHOtatAHilC CHARACTERISTICS OF THE ACAI»EMIC ACHIEVEMENT PEOGRAMS 



Prograa 

Academic Achieve- 
ment, Elementary 



Academic Achieve- 
ment, Secondary 



Grade 
Levels 
Served* 

1-6 



7-9 & 12 



i^proximate 
Number of 
Students Served 

2,099 



503 



Number of 
Full-Time 
Equivalent 
Teachers 

32.0 



11.0 



Number of 
Full-Time 
Equivalent 
Aides 

4.0 



0.0 



{^mber of 
School Sites 

23 



Prograa 
Setting 

Push-in 
(grade 1) 

and 
Pull-out 
(grades 2-6) 

Self -Con- 
tained 
Classroom 



Instructional 
Services 

~ Reading 

- Mathematics 



- Reading 

- Mathematics 



*Compensatory education services for first and twelfth graders started second semester. 



i' ERIC 



As can be seen from the chart above, the primary purpose of the programs 
is to improve the reading and mathematics achievement of a designated number 
of educationally disadvantaged children. The children in the program are 
screened for entry with the California Achievement Tests — Form E (CAT)l This 
year approximately 2,602 pupils are participating in the compensatory educa- 
tion programs* 

The broad goals of these programs are to: 1) provide intensive academic 
instruction to the educationally disadvantaged, 2) involve parents in the 
program, 3) supply students with incentives for academic achievement, 4) 
operate staff inservice programs, 5) measure academic growth, and 6) prepare 
students to effectively meet the academic competition of the general class- 
room. These goals are the focus of the Compensatory Education Department's 
activities throughout the 1988-89 school year* 
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PROCESS EVALUATION PROCEDURES 

A process evaluation involves monitoring a program throughout the year to 
determine if the program is being implemented as planned. This makes it pos- 
sible to identify strengths and weaknesses that influence a program's outcome. 
For these programs, the process evaluation was accomplished by means of a 
questionnaire, observation, and interview concerning various elements of the 
programs of interest to the director of the programs (see Appendix A for a 
copy of each of the three instruments). All compensatory education teachers 
were to be surveyed by questionnaire and each principal or assistant principal 
at the compensatory education buildings were interviewed. In addition, each 
elementary compensatory education teacher were observed during an entire 
compensatory education session. The questionnaires were distributed to the 
secondary respondents through inter-office mail on January 27, 1989 and to the 
elementary respondents at an inservice session of eLementary compensatory 
education teacher on January 30, 1989. The completed questionnaires were to 
be returned via inter-office mail by February 10, 1989. The interviews and 
observations started February I, 1989 and were completed by February 24, 1989. 
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PRESENTATION OF PROCESS MIA 

The Chapter l/Article 3 Process Evaluation Compensatory Education Teacher 

Questionnaire^ 1988-89 (see Appendix A for a copy) was sent out to A secon- 

2 

dary teachers on January 27, 1989 and A elementary teachers at an inservice 

on January 30, 1989. As of February 10, 1989 when results were tabulated, 5 

of the 16 (31.2%) secondary teachers and 27 of the 32 (84.4%) elementary 

teachers had returned the questionnaire. The detailed tabulated results are 

presented in Appendix B. 

The Chapter l/Article 3 Process Evaluation Teacher Observation Instrument 

for Grades 1-6, 1988-89 (see Appendix A for a copy) was used for elementary 

teacher observations which started on February 1, 1989 and were conpleted on 

February 21, 1989. All elementary A^ teachers (33 of 33) were observed 

either teaching a reading or a mathematics session. The results of these 

observations are presented in Appendix B. 

2 

The principals at all A siCes were interviewed using the Chapter 
l/Article 3 Process Evaluation Interview Oiide, 1988-89 , (see Appendix A for a 
copy). A total of 23 elementary and 6 secondary principals were interviewed 
from February 1 to 22, 1989. The in-depth interview findings are presented in 
Appendix B. 

What follows are the salient points stemming from this year's process 

2 

evaluation efforts of the 1988-89 A program. The five program evaluators who 
conducted the teacher observations and principal interviews reviewed the 
results and summarized them into the following categories which are presented 
below: strengths, weaknesses, and recommendations. 
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Strengths of the A2 Prograa 



From a combined review of current process findings and the present 
description of the program, the following strengths listed below appear note- 
worthy. The data source is listed parenthetically at the end of each point. 

• According to most of the elementary level compensatory 
education teachers (55. 52), the major strength of the 
program ms that it provided small group instruction. 
The secondary level compensatory education teachers were 
more divided in what they saw as the major strength, 
offering the following: small group instruction; monthly 
staff intiervices; sufficient funding for instructional 
materials; providing help to the most needy students; 
and offering students a chance to be successful (20.0% 
each). (Teacher Questionnaire) 

• Both elementary and secondary principals considered the 
provision of Individual attention within a small group 
setting, .to, .the- high need students as the major, strength 

-of the program (47;'8Z* and' 80.0%, respectively). (Prin- 
cipal Interview) . 

• Elementary compensatory education teachers have applied 
a number of instructional techniques related to the new- 
definition of reading which were provided to them through 
program inservices* The techniques used included: Mapping/ 
Story Frames (used by 77.7% of the -teachers); Know, Want, 
Learn (KWL) about a topic (used by 4 8.1%); directed read- 
ing-thinking activities (33.3%); and question-answer 
relationship (29.6%). (Teacher Questionnaire) 

• Elementary compeiisatory education teachers spend approxi- 
mately 60% of their instruction time teaching reading and 
the remaining 40% teaching mathematics. These proportions 
conform to those suggested by the program director. 
(Teacher Questionnaire) 

• Almost all of the elementary principals and all of the 
secondary principals had objective timelines in reading 
(91.3% and 100.0%, respectively) and in mathematics (8 7.0% 
and 100.0%, respectively). 

—Most of the principals (elementary 73.9% and secondary 
80.0%) used staff meetings to promote and/or facilitate 
the teacher's focusing on objective timelines. (Prin- 
cipal Interview) 

^In the 13 reading and 20 mathematics sessions obsarved, 
teachers stated the instructionl objectives. (Teacher 
Observation) 

6 
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• Both puslr;in and puil-out mathematics sessions were observed 
at the elementary level* (Teacher Observation) 

% Teacher methods generally seemed to involve direct instruc- 
tion* (Teacher Observation) 

• Documents showing student progress and attendance, teacher 
lesson plans, compensatory education schedules, and parent 
activities vera available in a large majority of classrooms 
(70.02 to lOO.OZ). (Teacher Observation) 

— The records W5re found to be up-to-date and complete in 
75% to 95Z of those classrooms with documents* 
(Teacher Observation) 

— The parent contact log provided by the program director 
was accepted by the majority of teachers (18: 56.3%), 
although minor modifications were suggested. (Teacher 
Questionnaire) 



Weaknesses of the A2 Program 

After a review of current process findings found In Appendix B and the 
present description of the program, the following current program weaknesses 
appear worthy of review. Again, the data source Is listed at the end of each 
point. 



• The major weakness of the program according to 79.0% of the 
elementary teachers v«s that the program changes were disrup- 
tive to program staff. According to 60.0% of the secondary 
teachers the major weakness was the program's lack of pre- 
pared materials. (Teacher Questionnaire) 

• Both elementary and secondary principals (30.4% and 60.0%, 
respectively) consider the program's focusing of services 
just upon the bottom quartile of students to be a major pro- 
gram weakness. (Principal Interview) 

• Other major weakness form the standpoint of elementary 
principals include the provision of too many inservices for 
elementary compensatory education .teachers and the lack of 
principal Involvement in the planning for changes in com- 
pensatory education programming (21.7% each). (Principal 
In terview) 

• A substantial number of elementary (7A. 1%) and secondary 
(40.0%) compensatory education teachers use informal methods 
of communicating with regular education teachers rather than 
using formal communication techniques. (Teacher Question- 
naire) 

• A total of 40.0% of thi^ secondary principals do nothing to 
encourage coordination of regular education and compensatory 
education teacher activities toward their building's weekly 
objectives. (Principal Interview) 

• Only 13.1% of the elementary principals and none of the 
secondary principals used classroom visits as a technique to 
promote/ facilitate the teachers' focusing on building-wide 
objective timelines. (Principal Interview) 

^ The wide ranges in instructional hours (15.25 hours and 24 
hours in reading for elementary and secondary, respectively; 
and 16.25 hours and 15 hours in mathematics for elementary 
and secondary, respectively), in preparation times (20 hours 
for elenentary and 6 for secondary staff), and in record 
keeping (9.75 at the elementary and 8 at the secondary level) 
implies a lack of uniformity in offered services. (Teacher 
Questionnaire) 



• A majority of the elementary compensatory education teachers 
(14: 51.9%) feel that there is not enough time to do record 
keeping, plan lessdns, and prepare materials. (Teacher Ques- 
tionnaire) 

• Some of the elementary principals (30.4%) are concerned over 
the "low certification standards" for coinpensatory education 
teachers, holding that staff who will work with high need 
children should be chosen on the basis of expertise/experi- 
ence. (Principal Interview) 

• Forty percent of the secondary principals believe that the 
program can be improved by offering compensatory mathematics 
classes in those secondary buildings without them. As wll, 
40.0% of the secondary principals believe improvements can be 
made by increasing the frequency of compensatory education 
Inservices offered at the secondary level. (Principal Inter- 
view) 

• Almost all of th'^ entary compensatory education sessions 
(32: 97.0%) occurrea without an aide or a parent present. 
(Teacher Observation) 

> <^ 

• The parent-teacher activity form was observed in 77.0% and 
70.0% of the reading and mathematics classrooms, respectively. 
However, oitly about half of the observed sheets were completed 
(62.0% in reading and 40.0% in mathematics). (Teacher Obser- 
vation) . 
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BECGMMENDATIONS 



Based on this year's process evaluation findings and the observations 
the evaluators involved in collecting the process data, the following recom- 
mendations are offered in an effort to improve the implementation of the A 
program in the future* 



• Plan out the school year's curriculum during the summer 
preceding the school year. Have in place and ready-to-go 
all of the activities that will occur during the year and 
be sure that all of the necessary information has been 
fully communicated to all parties concerned. 

• Develop a more systematic plan for communication and coor- 
dination of instructional matters on a regular basis. 
This plan should include methods to document communication 
between teachers, between principals and director, and 
between principals and teachers. This would also include 
methods of coordination of activities and objectives. 

• Examine the amount of time teachers spend on instruction, 
preparation, and paperwork to determine if time is being 
spent effectively and consistently. Within this examina-- 
tion, consider possible TOys to streamline the paperwork 
and/or centralize the development of instructional mate- 
rials. 

• Develop a system to allow input from the principals. This 
may include monthly conferences between principals and the 
program director and/or principal in-service sessions with 
the director. 

• Initiate rays to further involve the parents. This may 
include such activities as teacher helpers, pamphlets, 
newsletters, and/or calendars. 

• Incorporate secondary personnel more fully into the pro- 
gram. For example, provide consistent materials across, all 
sites, conducting at least three or four in-service ses- 
sions for them, and/or have compensatory education personnel 
explain the purpose of their program and how it relates to 
regular education programs at the secondary level. 

• Promote the communication of new teaching strategies by 
the compensatory education teachers back to the regular 
teachers through sharing during building staff meetings. 




In future years, consider initiating push-in sections at 
other grade levels, being sure to provide a 'consistent 
curriculum and inservice experience on team teaching to 
both compensatory education and regular education teachers. 
This could be done as part of a study to determine whether 
push-in's or pull-out's are more beneficial to students. 

Allow for the thoughtful inclusion of Instructional Theory 
Into Practice (ITIP) with Math Their Way and other inser- 
vice programs. The advice and recommendations of ITIP 
staff should be sought to implement this program as well 
as our inservice programs recommended in ^pendix B that 
impact directly on instructional' practices. 



APPEHDICES 




12 



17 



APPENDIX A 



CHAPTER 1/ARTICLB 3 PROCESS EVALUATION 
I 988-1989 

CCHPENSATORY EDUCATION TEACHER QDESTIONNAIRE 

To assist in planning efforts, the Department of Evaluation, Testing, and 
Research requests that each Chapter 1/Article 3 staff member complete the 
attached questionnaire regarding program^ operations. Many future project 
endeavors will be based upon your responses and reactions to the questions 
contained in this instrument* 

We want to obtain your individual perceptions about the programs, all 
responises will be kept confidential. Answer each question as it pertains to 
the programCs) you serve. 

If you have any questions, please call Richard Claus (ext. 256)* 

Please complete and return the questionnaire via inter-office mail to Richard 
Claus, Program Evaluation Division no later than February 10, 1989. 

School: Dat^: 



1* How much time do you spend teaching reading per week? 
Hours per week 

2, Hdw much time do you spend teaching mathematics per week? 
^ Hours per week 

3. IXiring an average mek (Sunday through Saturday), how much time do you 
spend on preparation for your compensatory education classes? 

Hours per week 

4/ Again, during an average week (Sunday through Saturday), how much time do 
you spend on record keeping for your compensatory education classes? 

Hours per week 

5, What suggestion do you have on how to keep records on parent contacts? 
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What techniques do you use to regularly communicate with the classroom 
teacher? (If possible attach an example if it exists in written form, if 
not please describe.) 



Many inservice sessions and discussions have been held relative to the n 
definition of reading during the past few years. What reading strategie 
if any, have you implemented related to this new definition in your com- 
pensatory education classroom? 



Name one or two strengths and weaknesses of the Chapter 1/Article 3 pro- 
gram. 

Strength Weakness 



What recommendations would you make to improve the overall compensatory 
education program? 



19 
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APPENDIX A 



CHAPTER 1/ARIICI£ 3 PROCESS EVALUATION 
1988-1989 

TEACHER OBSERVATION INSTROIENT FOR GRADES 1-6 



School: 

Teacher: 

Length of Observation: (Minutes) 

For the following dimensions "circle" the appropriate descriptors on the 
right : 

Subject Area Observed: Reading Matheaatlcs 

Instructional Setting: Pull-Out Push-In Other (please specify): 



Nunber of Students: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 

Aide or Parent Present: Yes No 



1. What was the instructional objective that the teacher stated to the 
pupils? 



2. Which of the following best describes the ta^cher input observed? 
(Check: 0 — Observed and A — Absent. A check (s/) should signify the 
typical mode of behavior observed, not merely a single isolated incident.] 

Mode of Behavior 0 A 



Mapping 

Kit type activity 
Chalkboard exercise 
Independent practice with ditto 
Teacher reading to students 
Student reading to teacher/students 
Choral reading 

Teaching mathematics with concrete objects 
Other (please specify): 

Other (please specify): 



. Comments: 
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3. Which of the following documents were available for review and their 
status? (Check: 0— K)bserved or A—Absent, and C~Complete or D— Delin- 
quent to indicate availability and status •) 

P<x^"^nt Availability Status Coments 

OA CD 

Progress Reporting Form 
Student Attendance Book 
Lesson Plan Book 
Compensatory Education Schedule 
Parent-^Teacher Activity Form 



• What general observations, if any, do you have aftrr this observation? 
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^PTER 1/ARTIClE 3 PROCESS KVALDATIOK 
1988-1989 
FRIW:iPAL IKIERVIEir GUIDE 



School: 



Date: 



!• How many of your students participate in the Chapter 1/Article 3 program? 



(Head count) 



2. What percent of your building's population is this hecid count of Chapter 1/ 
Article 3 participants? 



3. What are your building's reading and mathematics objectives for this week? 
Reading Objective(s): 



Mathematics Objective(s): 



^. How do you promote and/or facilitate teachers (both compensatory and regu- 
lar) focusing upon these objectives on a weekly basis? 



• What things have you done to encourage coordination of classroom and com- 
pensatory education teachers on these weekly objectives? 



I. Knowing that staff development ideas are important for both classroom and 
compensatory education teachers, what staff development topics would you 
suggest to enhance instruction of your compensatory education staff? 



X 100 



(Head count) 



(Total Student 
Po pulation) 
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one or two strengths and weaknesses of the Chapter 1/Article 3 pro- 
^£££Hfith Weakness 
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APPENDIX B 



CHAPTER l/ARTICU! 3 PROCESS EVALUATION 
1988-1989 

COHPSNSATORT EDUCATION TEACHER QUESTIONNAIRE 
(Eleaentary H«27 and Secondary N-5) 



1. How much time do you spend teaching reading per week? 

Elqucntary Secondary 

Average hours/week 12.27 13.50 

Bange« hours/week 15.25 24.00 

2. How much time do you spend teaching mathematics per week? 

Eleaentary Secondary 

Average hours/week 8.44 17.50 

Range hours/ week 16.25 15.00 

3. During an average w^ek (Sunday through Saturday), how much time do you spend on prepa- 
ration for your compensatory education classes? 

Elementary Secondary 

Average hours/week 7.78 5.00 

Range hours/ week 20.00 6.00 

4. Again, during an average week (Sunday through Saturday), how much time do you spend on 
record keeping for your compensatory education classes? 

Eleaentary Secondary 

Average hours/ week 2*86 3.60 

Range hours/week 9.75 8.00 



< 




APPEHDIZ B 








5. 


What suggestions do you have on how to keep records on parent 


contacts? 










Eleaentary* 


Secondary 






- Like the form provided by the program director 


8 


0 






- Allow for notes, phone call, etc. 


6 


1 






• Delete parent signature requirement 


3 


0 






• A dated guest book/ notebook instead of form 


2 


1 






- Monthly calendar notes 


1 


0 






- Preprinted carbonless 3x5 form that would be filed with 


1 


0 






parent name, date, type, and reason for contact to be 










checked off 










- Aides should be provided to make parent contacts 


1 


0 






- Not enough contacts to cause me a concern 


0 


1 




6. 


What techniques do you use to regularly communicate with the classroom teacher? 








EleaeaCary 


Secondary 






- Informal meetings 


20 


2 






- Teacher/ teacher conferences 


5 


0 






- Notebook carried between regular and compensatory 


4 


0 






education teachers 










- Weekly formal meetings with teachers 


4 


0 






- Written notes 


4 


0 






- Staff meetings 


3 


0 






- Each time students are escorted to and from regular 


3 


0 






classroom report made to teacher 










-Not applicable 


0 


3 






- Take part in. lEP meeting 


2 


0 






- Computerized test scores 




0 






- Student work sheets sent back to teacher 




0 






- Separate file folder for each child 


1 


0 






xeam Leacning sessions 




0 










0 


I 




*Count of respondents giving this comment by level. 
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?• Many liiservice sessions and discussions have been held relative to the new definition 
of reading during the past few years. What reading strategies, if any, have you 
implemented related to this new definition in your compensatory education classroom? 

Elementary Secondary 



- Mapping/story frames 


21 


2 


- Know, want, learn (KWL) about topic 


13 


2 


- Directed reading - thinking activity (DRTA) 


9 


1 


- Question-answer relationship (QAR) 


8 


1 


- Prior knowledge use 


7 


2 


- Predicting 


6 


0 


- Virginia Soper 


4 


0 


- Power writing 


3 


0 


- Highe r level questions 


2 


0 


- Thinking aloud 


2 


0 


- Problem solving 


2 


0 


- Success in reading and writing 


1 


0 


- Echo reading 


1 


0 


- Story line with pictures 


1 


0 


Made a significant change in teaching strategy 


1 


0 


- Modeling 


0 


1 


- SL3R 


0 


I 


- Fluency 


0 


I 


- Categorizing words 


0 


I 



• 8. Name one or two strengths and weaknesses of the Chapter 1/Article 3 program^ 

Strenjy >:h Blegentary Secondary 





Small group instruction 


15 


I 




Once a month inservice for staff 


7 


I 




Sufficient money to purchase instructional materials 


5 


I 




Communication/coordination with classroom teachers and 


5 


0 




principal 








Help to the most needy students 


3 


I 




Objectives and curriculum in place to follow 


3 


0 




Fewer students and teachers to vjork with has increased 


3 


0 




program effectiveness 








Gives students a chance to be successful each day 


2 


I 




Frequent monitoring of student achievement 


2 


0 




Exposes students to test taking techniques 


2 


0 




Our director is an effective administrator 




0 




Parent participation 




0 




Competent people to do the teaching 




0 




Math manipulatlves (Math Their Way) 




0 




Being able to work with students at different grade 




0 



levels 
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Weakness 

Program changes (e.g., staff assignments, program 
organization, timing of changes, class sizes, lack 
of one to one help, etc.) were disruptive to program 
effectiveness 
Not enough time to do record keeping, prepare mate- 
rials, and do planning 
Inadequate time for math instruction 
Lack of prepared materials for instruction 
Not enough cooperation from classroom teachers 
Insufficient time allotted for reading (i.e., 3 day) 
Too much testing 

Lack of sufficient time to cover material (30 minute 
period) 

Fever building based decisions on program operations 
Incoming out-of-xlistrict students fall through the 

cracks as they are not eligible until late in the year 
Successful Chapter 1 programs are penalized by cutting 

compensatory teachers in these buildings 
Lack of parent involvement component at each building 
Applying one method solution to compensatory education 

students 

Too many meetings/inservices to be effective with stu^ 
dentS' 

Progress reporting forms are to complicated to use 
Some teachers are not properly prepared for the areas 

they are teaching in compensatory education 
Having to serve as a substitute teacher too frequently 
Not enough opportunities to attend conferences in both 

readiiig and mathematics 
Aide should be available for record keeping and giving 

extra help 



Eleaentary Secondary 
17 I 



14 

5 
1 
3 
3 
3 
2 



0 
3 
0 
0 
0 
0 

0 
0 



0 
0 



0 
0 

0 
0 
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9* What recommendations would you make to Improve the overall compensatory education 
program? 

BecoMiendations Eleientary Secondary 

. - More time needs to be allowed for the following: 9 0 

material preparation; planning; biweekly teacher/ 
teacher conferences; record keeping; and incentive 
activities 

- 'Before major programming changes are made consult 5 0 

with compensatory education staff and tell them in 
June about changes in program design for the 
coming year and/or start program earlier in the 
year to allow for adjustments to be made 

- Allow for more professional decisions in teaching 3 1 

toward which objectives rather than compulsive 
adherence to objective timelines 

- Be consistent in distribution of pupils per teacher 4 0 

such that small group sizes can be maintained 

- Encourage greater cooperation in working on desig- 3 0 

.hated objectives between compensatory and classroom 
teachers 

- Better monetary support at start of school year 0 2 

- Emphasize the strengths of the program 2 0 

- Reduce emphasis of teaching toward the CAT test 2 0 

- Provide more outside training/inservices by excusing 2 0 

staff from building/grade level staff meetings 

- Allow for • flexibility in subject areas taught but main- 2 0 

tain equal case loads 

- Develop/employ an active parent component 1 0 

- Cut down/spread out time needed for testing 1 0 

- Develop a one page teacher referral form 1 0 

- Other factors beyond CAT testing should be allowed for 1 0 

to determine eligibility 

- Compensatory education meetings should be alternated 1 0 

from AM to PM sessions throughout the course of the 
school year to spread out scheduling disruptions 
~ Allow s^aff to attend multiple conferences because of 1 0 

dual subject area responsibilities 

- Allow flexible scheduling so students do not have to 1 0 

give up their electives 
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CHAPTER 1/ARTICLE 3 PROCESS EVALUATION 
; • . . 1988-1989 

PRINCIPAL INTERVIEir GUIDE 

t * 

(Kleeentary N»23 and Secondary N=«6) 



1. How many of your students participate in the Chapter 1/Article 3 program? 

Elementary Secondary 



Median student "count served 
Kange 



82 
150 



86 
129 



2. What percent of your building's population is this head count of Chapter l/Article 3 
participants? 



Eleaentary Secondary 



Low»st percent served 
Highest percent served 
Median percent served 



10.7% 
56.0% 
24.2% 



42.0% 
19.7% 



3. What are your building's reading and mathematics objectives for this week? 



Elementary Secondary 



Number and percent of buil do- 
ings with objective timeline 
in - 

Reading 
Mathematics 



21 (91.3%) 
20 (87.0%) 



5 (100.0%) 
3 (100.0%)* 



*Mathematics programs only operate at the three secondary Chapter 1 buildings. 



Comment: Building principals generally were not aware of the specific objectives 

for that particular veek when asked initially but were able to find their 
timeline or contact the teacher(s) in charge of the objective timeline. 
The specificity of objectives assigned was in common across grade levels. 



lERIC 
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How do you promote and/or facilitate teachers focusing upon these objectives on a 
waekly basis? 

Eleaentary Secondary 



- 


Staff meetings 


11 


4 


- 


Posted timeline of objectives 


8 


0 


- 


Weekly bulletin and/or PA announcement 


8 


0 


- 


Instructional material given In mall boxes on waekly 


5 


0 




basis 








Classroom visits 


3 


0 




Pre-testlng on a weekly basis 


3 


0 




Progress charts/ monitoring system of progress 


3 


0 




Chart average amount of time needed, to master objective(s) 


1 


0 




All staff involved in timeline development 


1 


0 




Grade level meetings 


1 


0 




Supportive of S P committee 


0 


1 




Tutorial program 


0 


I 




Compensatory education teacher required to teach one 


1 


0 




objective waekly on building objective 








Nothing 


0 


1 



What things have you done to encourage coordination of classiroom and compensatory 
education teachers on these weekly objectives? 

Elementary Secondary 



Staff meeting to focus on objectives and schedule 

Establish and maintain communication between regular 
and compensatory education teachers 

Teacher conferences each semester (regular and com- 
pensatory education teachers) 

Compensatory/ regular education teachers jointly select 
objectives, plan timeline, and voluntarily work 
toward the achievement of objectives 

Monitoring of instruction/ lesson plans 

Nothing, voluntary interactions 

Require children to take textbook and materials to 

compensatory education room 
Provides materials to all teachers 

Weekly^ teacher conferences (regular and compensatory 
education teachers) during physical education 
classes 

Use pre- and post-test results to monitor progress 
Trouble shooting committee meet with compensatory 

education teachers 
Public address system announcement 
Act as feedback linkage between teachers 



17 
8 

7 

4 



3 
0 
1 



3 
1 

0 

2 



0 
2 
0 

0 
0 



0 
0 

0 
0 
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Ehowing that staff development ideas are important for both classroom and compensatory 
education teachers, what staff development topics would you suggest to enhance 
instruction of your compensatory education staff? 



- More ideas/strategies for the new definition of reading 
■r Increase "math our way*! 

" Ideas to motivate slow learners 

- Coordination of ITIP procedures with mapping and other 

new strategies 

- How teachers can communicate effectively with each 

other (inter-personal relationships) 

• Following through on objective work between compensatory 

and regular education teachers 

• Parent invblyonent ideas 

• Activities to enhance classroom management through self- 

discipline of students 

• Team teaching concept 

- District-wide inservice on new definition of reading by 

outside expert 

• Working with CAT/MEAP scores to insure grade level 

achievement 

' Ways to incorporate counselors or their impact into the 

compensatory education program 
Learning styles/individual differences 
' Training for substitutes to enhance communication and 

instruction 

Informal assessment techniques in reading/mathematics to 

better diagnose problems 
Training in science and social studies 
Inservices for building administrators (instructional 

leaders) in the new techniques 
Techniques to enhance communication skills of students at 

grade level and beyond 
Time on task 
Cooperative learning 

Activities to enhance student self-concept 
Task analysis 

Activities to Impact test taking skills 
Activities to enhance study and note taking skills 
^Session for regular education teachers on what compensa- 
tory education is all about 
Techniques for teachers to set higher expectations with 
their students 



Elementary 

6 
6 
3 
3 

3 

a 

1 
2 

2 
2 

2 

2 



0 
0 



Secondary 

1 
0 
2 
0 

0 

0 

1 
0 

0 
0 

0 

0 

0 
0 



0 
0 



0 
0 
0 
0 
0 
0 

1 
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- 


'.■ 7. 


Name one or trao strengths and weaknesses of the Chapter. l/Article 3 program 


• 


t 






&X 69c u I. a I; y 


Secondary 






Providss helo to hiffh npp^i philrlnon in omall ctnnnnc 


1 1 

J. J. 


4 


t 




fmore Individual a^^pn^'^on^ 










Increased monltorlnff oF Qt"ivipnt"Q ftK"1pot"'fvp t-imol -f no 


o 


0 






(accountablllt y ) 






t 




Early Identification of need and orovlslon of service 


4 


0 






to need V s t udp'^. t on pcspntial oH^POt i vp c 

i^^^SAj 0(«\A*C*kU Vll COOCllCXdX Vl 1 C X VC O 






* 




St rons comnensatorv education teachers 


3 


1 






Helps students gain skills they may not have mastered 


3 


0 


\ 




at the elementary level 










In service oro^ram fo r staff wL th Innovative Id eas 


3 


0 






Piish~in nroffratn 

& UO 11 Xll r ^ O ^ 




0 ■; 


r 




Close UDrklnff relatlonshln Hetuepn rpffiilpr and oomnpn— 

>^XWOC <^VLKVX1*^ L CX Ck l> X V llO 11 X wC^WCCll L UX CI L dllU ^vlUwCll 


3 


0 






SAtorv pdiif*ptlon tp^^phprs 

oci i» V L y c u dcxvii ccd^ lie L o 










*^Success experiences orovlded nnnll s/stiidents 


2 


i 






Addition of first ?rade dodIIs 


2 


0 




- 


Regular and compensatory education teacher conference 


I 


0 


: 




Compensatory education teacher teaching mapping tech~ 


1 


0 






nlques to the rest of the staff 








- 


Strong program distrlct-wlde leadership 


I 


0 






Helps lower student/teacher ratio 


I 


0 






Greater narent nartlcloatlon 


1 

X 


0 






Focuses In on nrpotlo^il pnnl i^ptions nF rpadinff 
^v\«u<0^i0 Xll vii gv^ L. x^ox d u ux x^d c X V 11 o vj^l LcdUXilK 


n 

w 


1 






Teachers'^ schedules full dav without helo from nrinrlnpl 


1 


0 






liCdKIlcoo 


Ijll cuien L ary 


Secondary 






Focusir^ff UDOn thp Kn^^nm mi5»rf"'flp nf ef-it/lonf-e 


7 


3 






Too maiiv in service sessions 




0 






X^ck of Drincioal Involvement in nl i^nnincr For ^hancrpc 

^LXtAV>A^C2^ Xll V vX V dU C lie Xll ^X dllllXll^ Xvf L ^lidilKco 




0 


; 




in compensatory education 










Low certification standards for compensatory education 


3 


1 






tpachprs 










Pull-out orosram fragments learnings for nitnll s uho 


3 


0 






need more struct urp 










/^1f of ^*oorri i nij t i on K q t-u^a q n rtK^o^f^itroc nrtA a/» ^ 4tr4 ^ ■? o e 
*-*d v*tv WX L U Xild U XUil UcLmfcIl UUJcCLXVco anQ dCClVldcb 




0 






Comoensatorv education services stprt too l^tp 


0 


0 






Hiffh need Duildinffs lost ^*omnpns^^ torv pr1n<^ijtion cf^a f f 

AAx^ti A/ccu ii/uxxuxii^o X vf o C V*vf m^C ilod Cvi L jr CUuv«dUXvlll oUd^^ 


0 


0 






I^ck of adeouate oroffress with comnensptorv pr^nr^at'fon 

• *»>»*v CAV*^ «^ ^Lw^LCOO WX C 11 ^vUlUCllOd L y CUU^ddXVill 


2 


0 


' " - 




s t ud ents 










Too manv students for nroffr;wn to he Gitpr*PGcfii1 




1 


: / 




Sho uTfi U SP mo rp t niin ^p c ^ e /* a r*Q e a c e ^ ^ col o/»t*4rtTi 




1 


\ 




criteria 










£«dcn Duiiaing snouiQ nave ac least one ruil time com 




0 






pensatory education person 










Math focus not needed in some buildings 




0 






Math program needed in secondary west side sites 




1 






Parent inservice 1 Acklnc 

XIAOC^ vxv*w Xd^ Cv X 1 In 




0 






Parents see oro^ram as belns soecial education 


Q 


1 


1./. 




Facilities lacking 




0 
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Weakness (Cont^d) Elenentary Secondary 

Limited resources 0 1 

Not enough done for non-academic needs 0 1 

Scheduling changes caused by three changes in student 0 1 

eligibility cut-offs lead t;o scheduling problems 

Curriculum being driven by test results (CAT/MEAP) 1 0 

Compensatory education teachers should .share what they 1 0 

have learned at inservice sessions 

The director should do more monitoring of staff after 1 0 

staff problems have been identified 



8, What recommendations would you make to improve ;he overall compensatory education 
program? 

Eleaentary Secondary 

- Hand. pick staff on the basis of expertise/certif ica- 7 1 

tion to help high need kids 

- Develop a cluster "parenting" programs 3 1 

- Increased coordination/dialogue between compensatory 4 0 

and regular education teachers 

- Each building should have at least one full-time com- 3 0 

pensatory teacher until the percent of needy is 
significantly lowered over a number of years 

- Different way to schedule meetings so they don't take 3 0 

away from the same students instructional time 

- Statement of program design at year's end for next 2 1 - 

year to provide for a smoother start-up in the fall 

- Involvement of principal/staff in budge t/program- design 2 • 1 

- Allow for counseling to deal with social and emotional 2 I 

problems of "at risk" youngsters 

- More on-site visits by compensatory education director 2 0 

- Increase number of students served by increasing stu- 2 0 

dent/ teacher ratio 

- Responsibility for success of program should be princi- 2 0 

pals 

- Add math compensatory education classes at secondary 0 2 

- Increase frequency of compensatory education inservices 0 2 

at secondary with compensatory education director 

- Better program facilities (e.g., small sized self- 2 0 

contained classrooms) 

- Math and English compensatory education classes should 0 1 

be in addition to the regular classes and not in lieu 
of them 

- Tracking of compensatory education students to determine 0 1 

if elementary participants continue to be eligible at 
the junior and senior high school levels 
-Merit pay should be ^provided exceptional compensatory 0 1 

education teachers 

- Each teacher should attend a workshop on a yearly basis 0 1 

related to teaching compensatory education students 
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8. (Continued) 



Eleaeatary 



Additional preparation time for compensatory education 

teachers should be provided 
More than three days of reading should be allotted per 

vieek at buildings with little or no math problems 
Compensatory teachers should not be pulled away from the 

buildings during the month of September as buildings 

start up 

Explore the model program of Abbottston as described in 

the February, 1989 Educational Leadership 
Increase ability of compensatory teachers to wrk with 

specific discipline problems 
Begin compensatory education classes in kindergarten 
Include as a measure of program success the percent change 

in students in the following year's program at each 

building 

Inservice staff on how to establish effective interpersonal 

working relationships 
Provide an aide to "over-loaded" teachers 

Group students by need level and diversify schedule so that 
those who are most needy (those with the lowest percent- 
ile scores) have proportionally more compensatory educa- 
tional instructional time 

Selection process should allow for teacher observations 
along with test scores 

Do whole grade testing to see how program effects all first 
grade students not just compensatory education students 
to determine the overall effectiveness of the push-in 
program 



Secondary 

0 
0 
0 

0 

0 

0 
0 



0 
0 



0 
0 
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CMPTER 1/AETICLE 3 PROCESS EVAHMiTION 
1988-1989 

TEACHER OBSERVATION INSTRllffiNT F(» GSAI^ 1-6 
(Eleaentary Teachers N»33) 



Length of observation in minutes: 



Reading Mathematics 



- Average length 

- Shortest session 

- Longest session 



29 
16 
60 



35 
24 
60 



Instructional setting of observed classes: 



Reading Matheaatics 



Pull-out 
Push-in 



13 
0 



10 
10 



Number of students in observed classes: 

Reading 



Average number 
Fewsst number 
Largest ntaiber 



5 
2 
11 



Mathematics 

8 
1 
19 



Number of classes where aide or parent was present: 

Reading Mathematics 
0 1 
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!• What was the instructional objective that the teacher stated to the pupils? 
Re ading 

- Details - how one determines what is taking place 3* 

- Main idea - comprehension 3 

- Analogies * 2 

- Multiple meaningis 2 

- Review of comprehension skills 1 

- Spelling -identify the correctly spelled word out of a list of 1 

four words 

- Word recognition 1 
Mathematics 



-Addition with concrete objects 9 

- Basic addition facts linked with everyday life 2 

- Review of fractions (addition) 2 

- Vocabulary/usage of addition and subtraction terms in word problems 2 

- Halves/fractions with shapes 

- Two digit addition and subtraction 

- Geometry - naming shapes 

- Place values/rounding to the nearest thousands place 

- Multiplication of two and three digits 

*Count of respondents giving this comment by level. 



2; Which of the following best describes the teacher input observed? 



Mode of behavior observed: Reading Mathematics 

- Mapping 4 0 

- Kit type activity 2 4 

- Chalkboard exercise 3 3 

- Independent practice with ditto 6 4 

- Teacher reading to students 4 2 

- Student reading to teacher/students 9 7 

- Choral reading 4 1 

- Teaching mathematics with concrete objects - 12 

- Other: 

— Question and answer 6 0 

— Guided practice 4 6 

— Homework 1 0 

— Journal entry 1 0 

— Oral recitation 1 0 

— Dictionary practice 1 0 

— Drill and practice 0 3 

— Modeling 0 2 
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Read Ing 



MathematicT. 



Comments: 



- Teacher very enthusiastic about the success of the 

students 

- Instructor worked well with the group 

- Incorrect grammar was used by the instructor and was 

reinforced during the instruction 

- Students knew what was expected of them 

- Use of reward (e.g., Valentine candy and stickers) 

- Students appeared very enthusiastic 

- Use of pennies to help students with addition problems 

- Real life examples were incorporated into the instruc- 

tion 

- Students felt free to check with the teacher regarding 

their progress on the activity 

- Teacher drew cartoon figures for each student as an 

visual aid 

- Compensatory education instructor also helped non 

compensatory education students in a push-in environ- 
ment 

- Instructor divided their time equally between regular 

and compensatory education students 



0 
0 
0 
0 
0 

0 

0 

0 



1 

0 

3 
3 
2 



Which of the following documents were available for review and their status? 

Reading Math 



Availability of documents; 

- Progress reporting form 

- Student attendance book 

- Lesson plan book 

- Compensatory education schedule 

- Parent-teacher activity form 



Observed 


Absent 


Observed 


Absent 


N % 


N 


% 


N 


% 


N % 


12 92 


1 


8 


19 


95 


1 5 


12 92 


1 


8 


20 


100 




13 100 






20 


100 




11 85 


2 


15 


19 


100 


1 5 


10 77 


3 


23 


14 


70 


6 30 



Status of documents: 

- Progress reporting form 

- Student attendance book 

- Lesson plan book 

- Compensatory education schedule 

- Pa rent- teacher activity form 



Reading- 
Complete Delinquent 



Math 



Complete Delinquent 



N 


% 


N 


% 


N 


% 


N 


% 


10 


77 


3 


23 


15 


75 


5 


25 


11 


85 


2 


15 


18 


90 


2 


10 


12 


92 


1 


8 


19 


95 


1 


5 


11 


85 


2 


15 


19 


95 


1 


5 


8 


62 


5 


39 


8 


40 


12 


60 
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What general observations, i€ any, do you have after this observation? 

Reading Mathematics 





trusn in program appsarec woncaDxe v^teacners woriced 


0 


3 




weii uogecner^ « 








Dcuaencs v»scea iiccie cinie v^woric aiiigenciy^ 


0 


3 




leacner >»s very concerned •about aiscipiine and stopped 


0 


3 




orcen uo orxng orcier 








wcix ur{^aiix«cci cxass usxug previews ana reviews or cne 




0 




topics covered 








leacner rocusea on cne positive sicie or cne student s 


U 


2 




pL U^L coo 








A o ^ n A t* It A nf* o ^41a /^n ao/«T^ ^f** «/9 a n 4* 

leacner Kept a me on eacn scuuenu 


U 


2 




vTooa rappor.L was apparent oecween teacne r/stuuent 


1 


1 




Dite sciix in neeci or some minor sec up details 


U 


1 




fLUj^LCOO LcpULUXll^ L\J LUX LU C UIUU C L O UUlc 


U 


1 




Stickers used as rewards 


0 


1 




Teamwork was not as obvious, yet it was harmonious 


0 


1 




Teacher \«is somewhat negative with the group 


0 


1 




Some students did not appear to understand what was 


0 


1 




going on, manipulatives might have been used 








Teacher works well with the students, yet is begrudging 


0 


1 




in regard to paper work and record keeping 








Objective seemed to be behind first grade curriculum. 


0 


1 




Thus it ms hard to keep all students busy 








Teacher worked well with students given less than 


0 


1 



optimal conditions 
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